Papers with language specific pre-trained models
Effectiveness of French Language Models on Abstractive Dialogue Summarization Task (2022.lrec-1)
Copied to clipboard
| Challenge: | Pre-trained language models have established the state-of-the-art on various natural language processing tasks, including dialogue summarization. |
| Approach: | They propose to use several language specific pre-trained models to summarize spontaneous oral dialogues in French using several language-specific pre-trainers: BARThez, BelGPT-2, mBARThes, and mT5. |
| Outcome: | The proposed models outperform the existing models on the DECODA (Call Center) dialogue corpus and show that they are far superior to the current models. |